Exploiting the Synergy between Different Modalities in Multimodal Information Retrieval

In this work, we address the issue of exploiting the synergy between different modalities to facilitate Internet information retrieval. It is well-known that information typically exists jointly in different modalities, and this is true for information in the Internet. We intend to demonstrate that exploiting the synergy between the different modalities of the information may enhance the information retrieval efficiency and effectiveness. Specifically, we focus on exploiting the cognitive synergy between text and imagery modalities. Machine learning techniques are used to explicitly exploit this synergy in order to address the effective retrieval of the multimedia information represented in the two modalities. We will demonstrate the proposed methodology through experimental data.